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ABSTRACT 

Type I error rates were est imat ed for three tests 
that compare means by using data from two independent samples: the 
independent samples t test, Welch's approximate degrees of freedom 
test, and James's second order test. Type I error rates were 
estimated for skewed distributions, equal and unequal variances, 
equal and unequal sample sizes, and a range of total sample sizes. 
Welch's test and James's test have very similar Type I error rates 
and tend to control the Type I error rate as well or better than the 
independent samples t test does. The results provide guidance about 
the total sample sizes required for controlling Type I error rates. 
Nine tables are included. (Contains 16 references.) (Author) 
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Table 2 

Estimated Type I Error Rates fr; for Welch's Test: Lognormal Distribution 
and or * . os 



N 




1 






7/13 ■ 






1/3 




d - 1 


d - 2 


d = 3 


d = 1 


d * 2 


d « 3 


d - 1 


d » 2 


d > 3 


100 


. 0407 


. 0638 


.0807 


.0525 


.0897 


. 1009 


. 0633 


. 1030 


.1166 


200 


. 0449 


. 0605 


.0707 


.04 87 


.0729 


. 0818 


. 0616 


. 0865 


.0979 


300 


. 0488 


.0561 


.0657 


.0528 


.0687 


. 0697 


. 0626 


.0746 


.0862 


400 


. 0457 


. 0533 


.0642 


.0484 


.0609 


. 0685 


. 0574 


.07 57 


.0809 


500 


. 0462 


. 0551 


.0600 


.0534 


.0604 


.0642 


. 0579 


.0694 


.0755 


600 


.0463 


. 0552 


.0609 


.0541 


.0634 


.0656 


. 0587 


. 0636 


.0728 


700 


. 0518 


. 0509 


. 0570 


.0528 


.0569 


. 0608 


. 0547 


. 0685 


.0680 



Note . The quantity d = d/d 



Table 3 

Estimated Type 1 Error Rates (t) for t: Lognormal Distribution and ot » .05 



N 




1 






7/13 






1/3 




d » 1 


d = 2 


d * 3 


d = i 


d - 2 


d - 3 


d - 1 


d - 2 


d - 3 


100 


. 0416 


.0649 


.0817 


.0430 


.1157 


.1636 


.04 53 


.1569 


.2316 


200 


.0451 


.0612 


.0715 


.0453 


.1102 


.1413 


. 0470 


.1488 


.2228 


300 


.0488 


.0563 


. 0662 


.0485 


. 1088 


.1347 


.0475 


.1579 


.2178 


400 


. 0457 


. 0535 


. 0646 


.0462 


.1024 


.1361 


.0477 


.1520 


.2157 


500 


.0462 


. 0544 


. 0602 


.0506 


. 1043 


.1333 


. 0522 


.1566 


.2071 


600 


.0464 


. 0533 


.0613 


.0504 


. 1064 


.1312 


.04 80 


. 1472 


.2166 


700 


. 0519 


. 0510 


.0572 


. 0484 


. 1009 


.1291 


.0479 


.1542 


.2058 



Note . The quantity d * ct,/cti 
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Table 4 

Estimated Type I Error Rates it) for Welch's Test: Lognormal Distribution 
and or = , 01 



n i /n i 



N 










7/13 






1/3 




d = l 


d = 2 


d = 3 


d = 1 


d - 2 


d * 3 


d » 1 


d > 2 


d - 3 


100 


.0068 


.0196 


. 0321 


. 0099 


. 0394 


. 04 59 


. 0162 


. 047 1 


. 0604 


200 


. 0082 


. 0174 


. 0254 


. 0103 


. 0342 


. 0341 


. 0170 


. 0365 


. 0474 


300 


. 0086 


,0x44 


.0200 


. 0099 


. 0269 


. 0280 


. 0180 


. 0311 


. 0376 


400 


. 0090 


.0121 


. 0191 


. 0088 


,0197 


. 0235 


. 0176 


. 0294 


. 0327 


500 


. 0078 


.0152 


.0167 


. 0113 


. 0208 


. 0210 


. 0148 


. 0256 


. 0310 


600 


-0088 


,0134 


.0190 


. 0101 


. 0200 


. 0233 


,0142 


,0237 


. 027 3 


700 


.0096 


.0122 


.0162 


. 0110 


.0196 


. 0199 


.0126 


.0233 


, 0249 



Note . The quantity d = Gt/oi 



20 

Table 5 

Estimated Type I Error Rates (t) for Welch's Test: Exponential Distribution 
and a * ,05 



N 




1 






7/13 






1/3 




d * 1 


d * 2 


d r 3 


d * 1 


d = 2 


d * 3 


d = 1 


d * 2 


d . 3 


20 


. 0380 


.0711 


.0905 


. 0491 


. 0942 


. 0994 


. 0694 


.1133 


. 1163 


60 


.0475 


,0555 


. 0671 


. 0515 


. 07 20 


. 0799 


. 0615 


.0820 


.0823 


100 


. 0466 


.0557 


.0571 


. 0521 


. 0632 


.0656 


. 0554 


.07 03 


. 07 52 


140 


. 0495 


.0550 


.0581 


, 0494 


. 06 04 


.0602 


. 0574 


.0657 


. 0682 



Note . The quantity d = aj/oi 



1.9 



Table 6 

£3". imated Tys% I Error Rate3 (r) for Welch's Test: Beta Distribution and 



n 3 /n i 



N 




1 






7/13 






1/3 


d - 3 


d * 1 


d . 2 


d - 3 


d = 1 


d - 2 


d » 3 


d - 1 


d - 2 


20 


.0448 


.0548 


.0672 


. 0522 


.0721 


.0785 


. 0668 


. 0870 


.0835 


40 


.0491 


. 0531 


. 0581 


.0527 


. 0622 


. 0664 


. 057 1 


. 0663 


.0692 


60 


.0493 


. 0501 


. 0592 


. 0527 


. 0587 


. 0595 


. 0559 


. 0617 


. 0650 


80 


.0519 


. 0519 


. 057 8 


. 0500 


. 0525 


. 0595 


. 0565 


. 0601 


.0599 



The quant icy d » tfj/(Ti 
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Table 7 

Estimated Type I Error Rates (t) for welch 1 3 Test: a » .05 



N 




1 


13/7 






3 




d - 1 


d - 2 d » 3 d = 1 


d - 2 


d - 3 


d - 1 


d - 2 


d * 3 






Lognormal Distribution 












40 


. 0378 


.0769 .1024 .0496 


.0409 


. 0746 


. 0656 


.0364 


. 0591 


100 


. 0407 


.0657 .0B47 .0510 


. 0480 


. 0654 


. 0608 


.0463 


. 0504 


160 


. 0432 


. 0663 . 0742 .0507 


.0495 


. 0631 


. 0615 


.0438 


. 0520 






Exponent ial Dist ri but ion 












20 


. 0380 


.0716 .0905 .0491 


. 0455 


. 0650 


.0684 


.0354 


. 0465 


40 


. 0457 


.0634 .0731 .0527 


. 0486 


. 0583 


.0615 


. 04 50 


. 0506 






Beta Distribution 












20 


. 0448 


.0548 .0672 .0522 


.0511 


. 0619 


. 0668 


.04 31 


. 0496 


40 


. 0491 


.0531 .0581 .0527 


. 0475 


. 0514 


.0571 


.0483 


. 0547 



Note. The quantity d » <?,/ff, 



20 



